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Abstract 



In [5] we generalized the first and second fundamental theorems of invariant 
theory from the general linear group to the general linear Lie superalgebra. 
In the current paper we generalize the computations of the the numerical 
invariants (multiplicities and Poincare series) to the superalgebra case. The 
results involve either inner products of symmetric functions in two sets of 
variables, or complex integrals. 
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Introduction 



Formanek's paper [7J, based partly on Procesi's [9], has been a major influ- 
ence on my work. One of the things Formanek does is describe a certain 
question which can be posed from five different points of view: (1) Inner 
products of symmetric group characters; (2) plethysms of symmetric func- 
tions; (3) invariants of matrices; (4) trace rings of generic matrices; and (5) 
complex integrals. Here is a brief description of each: 

Problem 1 Let A&(n) be the partitions of n into at most k parts, let = 
U n A/ c (n), and let x X denote the character of the symmetric group S n 
on the partition A. Then the sum ^AeA fc (n) X X ® X X decomposes into 
irreducible characters as ^ m\x X and we would like to evaluate the 
multiplicities m\. 

Problem 2 Let S\ denote the Schur function on the partition A. Let X 
denote the set of variables {x\, . . . , z&}, and let S\(XX ) denote S\ 
evaluated on all xy~ 1 , x, y £ X (including n l's). Then m\ also equals 
(S\(XX~ 1 ), 1), where the inner product is the natural inner product 
on symmetric functions as in 1.4 of [Sj. 

Problem 3 Consider functions <f> : Mk{F) n — > F which are polynomial in 
the entries and such that 

<\){gA x g- x , . . .,gA n g~ l ) = <j>{Ai, ....An) 

for all A\,. . . ,A n £ Mk(F) and all g E GLk{F). Such a function is 
said to be invariant under conjugation from GLf~(F). They form a 
ring with an n-fold grading and determine a Poincare series P(k,n). 
Since P(k, n) is a symmetric function it can be expanded into Schur 
functions as 

P(k, n) = } j m x S\(ti, ...,t n ) 

where the m\ are the heros of Problems 1 and 2. 

Problem 4 Let X a be the generic k x k matrix with entries X a = (a;y ), 
and let R(k,n) be the algebra generated by X\, . . . ,X n - Let C(k,n) 
be the commutative algebra generated by traces of elements of R(k, n). 
Then C(k, n) has an n-fold grading and so a Poincare series in n vari- 
ables. This series equals P(k, n) from Problem 3. 
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Problem 5 The function P(k, n) can be evaluated as the following complex 
integral: 

where i,j = 1, ...,/s and a = l,...,n, and where T is the torus 

N = 1. 

Having five ways to look at the same object is useful for proving things 
about it. Properties 3 and 5 are useful for actual computations, but also 
have theoretical consequences. Using (3) it is easy to show that m\ = 
if A ^ A k 2, and if A G A k 2 and fj, = (Ai + a, . . . , \ k 2 + a), then m\ = m^. 
Using (5) one can show that P(n, k) is a rational function, that it can be 
written with denominator a product of terms of the form (1 — u), where 
u is a monic monomial of degree at most k, and that P(n, k) satisfies the 
functional equation 

p(tr\ . . . , t- 1 ) = (-1)^ • • • t n fp(h, t k ), (i) 

where g = (n — l)k 2 + 1. 

This theory has a Z,2-graded analogue which we sketch briefly, see [2] . In 
this theory there are analogues of (1), (3) and (4), but not of (2) and (5). 
Here are the analogues: 

Problem la Let H(k,£;n) be the set of partitions of n in which at most 
k parts are greater than or equal to £, and let H(k,£) = U n H(k,£; n). 
Using the standard notation for partitions A = (Ai, A2, • • .) with Ai > 
A 2 > • • • , we have 

A e H(k,£) Afc+i < £. 

The character of interest is ^ x X ® X X summed over A G H(k, £; n) 
and we define the multiplicities m\ by 

\eH{k/;n) 

Problem 3a Let E be an infinite dimensional Grassmann algebra. It has 
a natural Z2 grading. We give the set {1, . . . , k + £} a Z2 grading via 



deg(i) 



if 1 < % < k 

1 iik + l<i<k + £ 
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and then grade the pairs j" = i via deg(i, j) = deg(i) + deg(j). 

The algebra is a subalgebra of M^+^E) defined as the set of 

matrices (aij) such that for each (i, j) the entry G E is homogeneous 
and has the same Z2 degree as Then M^/ is an algebra and it 

has a non-degenerate trace with values in Eq given by 

tr( aij ) = ]T(-l) deg(i W 

The group of units of Mk/ is denoted PL(k, £) and is called the general 
linear Lie superalgebra. 

Finally, we consider functions 4> '■ ~^ E-> polynomial in the entries 
and invariant under conjugation from PL(k,£). These form an n-fold 
graded algebra with Poincare series ^ m\S\(ti, . . . ,t n ), the same m\ 
as in problem la. 

Problem 4a Let xif 1 be commuting indeterminants and let be anti- 

commuting indeterminants, so that the algebra S = F[x\j\ e if\ wm 
be a free supercommutative algebra. The generic matrix A a will be 
the (k + €) x [k + i) matrix with entry equal to x^' or e-"\ 

depending on whether deg(z,j) equals or 1, respectively. Then the 
algebra jF[Al 3 . . . , A n ] will be the generic algebra for M/.^. It has a 
trace function with image in S, and we let C(k,£;n) be the algebra 
generated by the image of the trace map. This ring has an n-fold 
grading and a Poincare series in n variables, the same series ^ rn\S\ 
from 3a. 

It is useful to push this last construction one step farther. Let B a be the 
(k + £) x {k + t) matrix with (i, j) equal to e ** if deg(i, j) is and if 
deg(i, j) = I, the opposite of the definition of A a . Let R(k, £;n,m) be the 
algebra generated by A\ , . . . , A n and B\ , . . . , B m . (For the reader familiar 
with the theory of magnums from [1 j. this is the magnum of M^.) It has 
a supertrace function to S and we let C(k, £; n, m) be the algebra generated 
by the traces. C(k, i\ n, m) has a (k+£) x (k+£) fold grading and a Poincare 
series which can be expressed in terms of hook Schur functions as 

P(k, £; n, m) = y~] m\HS x (h, . . . , t n \ u t , . . . , u m ), 

where the m\ are as in la. See [5] for the theory of hook Schur functions. 

Such a construction would also be possible in the matrix case (see [1]), 
but it would be less useful. A basic property of Schur functions is that 
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S\(t\, . . . ,tk) is non-zero precisely when A G A&. And, in the matrix case, 
m\ = if A ^ A fc 2 . This means that we can reconstruct all the m\ from the 
Poincare series P(k, n) as long as n > k 2 . In the case of i, it is known that 
HS\(xi, . . . , x n ;yi, . . . , y m ) is non-zero if and only if A G H(n, m) and that 
m\ ^ only if A G H(k 2 + £ 2 ; 2k£). It follows that we get full information 
about the non-zero m\ if we know the Poincare series H(k, £; n, m) for some 
n > k 2 + £ 2 , m > 2k£. 

Our main goal in this paper is to present partial generalizations of prob- 
lems 2 and 5 to the graded case. Let X denote the set of k variables 
{xi, . . . , Xfc} and let Y denote the set of £ variables {yi, . . . , y^j.Then for 
certain A which we call "large" and which include most of H(k 2 + £ 2 ;2k£) 
we prove 

mx = / + ^VjYHl + Xiyf^HSxiXX- 1 ^- 1 ; XY~\ YX' 1 ), 1 

\ ij I 

(2) 

where the inner product is the inner product on functions symmetric on two 
sets of variables. We will define it explicitly in section 1. 

Equation (|2|) has an application in the case of typical A. A partition in 
H (a; b) but not in any strictly smaller hook is called typical, and the set of 
such is denoted H' (a; b). Such a partition can be thought of as being made 
up of three parts: The a x b rectangle, a partition a(A) G A a to the right 
of the rectangle, and a partition /3(A) G A^ whose conjugate lies below the 
rectangle. Hopefully Figure 1 makes this clear, but if not we add that if 
A = (Ax, A2, • • •) then a(A) = (Ai — b, . . . , A a — b) and /3(A) is the conjugate of 
(A a+ i, A a+ 2, • • •)• The importance of typical partitions for our purposes lies 
in this factorization theorem for hook Schur functions from [5]. Note that 
the number of x's and y's in the theorem equal the dimensions of the hook. 

Theorem 0.1 (The Factorization Theorem). If X € H'(a,b) with a = a(A) 
and (3 = /3(A) then 

HS\(xi, ...,x a ;yi,...,y b ) = ~[[{ x i + Vj)S a (xi, x a )Sp(yi, ...,yb) 

Combining the factorization theorem with ([2]) we get the following. 

Theorem 0.2. Given X,fj, G H'(k 2 + £ 2 ;2k£) with a(A) = a(//) + (a fc2+£2 ) 
for some a and /3(A) = /3(/i) + (b 2ki ) for some b, then mx = ma- (See Figure 
2). 
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a(X) 



/3(A)' 



Figure 1: Definition of a(X) and /3(A) 

a 



Figure 2: Theorem 107 



Proof. S a (\)(XX-i,YY-' 1 ) = 

( LI z ) a ^(/i)(xx- 1 ,ry- 1 ) 

l a • ^(^(xi-^yy- 1 )' 
And by the same token S^XY' 1 , YX~ l ) = SgQ^j (IF -1 , FX -1 ) 



□ 



Turning to Poincare series, since we do not know all of the m\ we cannot 
hope to capture the full ^ m\S\ or Yl< m \HS\, even in small numbers of 
variables. There are two related infinite series we can express as integrals 
and derive information about. For the first, let m' x be the right hand side 
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of ([2]), so m\ = m' x for large A. Then we may define 

P'(k,£;a,b) = y~]m' x HS x (tx, ■ ■ ■ ,t a ; u\, . . . ,u b ) 

summed over all A € H(a,b). Or instead, we may restrict to typical parti- 
tions and define 

T(k,£;a,b)= ^ m x S a ^)(ti, ■ ■ ■ , t a )S^ X )(yi, ■ ■ ■ , Vb)- 

A typical 

Using ([2]) we can write each of these series as a complex integral over a torus. 
The integrals are too complex to embellish an introduction, and perhaps too 
complex for much actual computation. However, at least in the case of T 
we can use the integral to prove that the T(k,£;a,b) is the Taylor series 
of a rational function, we can describe what type of terms occur in the 
denominator, and we can prove a functional equation similar to (pQ). 

Ideally we would like information about all of the m x , not just for large 
or typical A. If 

P(k,£;a,b) = y~]m x HS\(ti, . . . ,t a ;ui, . . .,u b ), 

then it is still open whether P(k,£;a,b) is a rational function, what its 
denominator looks like if it is, and whether it satisfies a functional equation 
along the lines of ([T]). See Corollary 14.31 for a case in which it does not. 

In the classical case described by Formanek one is also interested in the 
character 

AeA fe (n+l) 

where the arrow indicates inducing down from S n +i to S n . Each of prob- 
lems 1 through 5 have analogues in this case. The analogue of the invariant 
theory problem would concern the invariant maps Mf c (F) n — > Mk{F). Gen- 
eralizing to the ^2-graded case we would define 

XeH(k,t;n+l) 

and study the fh x . It turns out that analogues of problems 3 and 4 are known 
in this case, see [2], and that we can now develop analogues of problems 2 
and 5, just like we did for m x . The theory is very similar. The formula 
for m x for large enough A is the same as equation [2] with an extra factor 
of ^2 Xixj 1 + UiUj 1 and the same factor multiplies the integrands in the 
formulas for the power series T(k,£;a,b) and P(k,£;a,b). 
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1 Computation of Multiplicities 

Notation 1.1. Given partitions /j,, v h n of the same n, we define the 
coefficients 7* via the equation x^ 1 ® X u = Ylw-n^^X^- Note that from 
Problem la this implies 



We set the stage for the computation of m\ by quoting two theorems 

Theorem 1.2 (Berele-Regev [5]). If fi 6 H(ki,li) and v G H(k 2 ,£ 2 ), then 
= wiZess A G H(kik 2 + k\l 2 + £\k 2 ) 

Definition 1.3. Given we say that a partition A is large if A G H(k 2 + 
£ 2 ; 2k£) but A ^ H(a 2 + 6 2 ; 2a6) for any a < k, b < £ and at least one of the 
inequalities strict. Note that typical partitions are all large. 

Using this definition we get this corollary of Theorem 11.21 

Lemma 1.4. If X is large and G H(k,£), then j* v ^ only if /x and v 
are typical. 

The next theorem we need is due to Rosas from [12]. It generalizes 
the classical result that given two sets of variables X and Y, S\(XY) = 
Yllu,vSij,(X)S ll (Y). This paper of Rosas was our inspiration for our ap- 
proach to 7^„. 

Theorem 1.5 (Rosas). Given four sets of variables X, Y, T, and U, 



HS X (XT,YU;XU,YT) =J2^HS^(X;Y)HS U (T;U). 

Lemma 1.6. Let A G H(k 2 + £ 2 ;2k£) be large and let X, Y , T, and U be 

sets of variables with cardinalities \X\ = \T\ = k and \Y\ = \U\ = t. Then 



is a polynomial, symmetric in each of the four sets of variables. Hence, it 
can be expanded in terms of Schur functions. This expansion involves only 
typical [A and v and equals is 




(3) 



Y[ (x + y)- 1 J] (t + u)- l HS x {XT, YU; XU, YT) 



yeY ueu 



^2 T^i^CaO ( X ) S P(/i) ( Y ) S a(u) ( T )S/3(u) (U) . 
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Proof. By Theorem 11.51 

HS X (XT,YU;XU,YT) = Y /1 ^HS fl (X;Y)HS u (T;U). 

By Lemma 11.41 for each non-zero j£ v \i and v are typical and so we may 
apply the Factorization Theorem, Theorem lO.il 

HS,(X;Y) = H(x + y)S a(ll) (X)S m (Y) 

and 

HS V {T; U) = ]J(t + u)S a{v) (T)S m (U). 
The theorem now follows. □ 

Definition 1.7. Given two finite sets of variables, the space of polynomials 
f(X,Y) which are symmetric in each has an inner product with respect 
to which the S^(X)S U (Y) are orthonormal. If p(X) is defined to be the 
product of the elements of X and p(Y) to be the product of the elements 
of Y, then the inner product extends to symmetric rational functions with 
denominator a power of p(X) times a power of p(Y) such that 

(p(X)f(S,Y),p(X)g(X,Y)) = (f(X,Y),g(X,Y)) 

and 

( P (Y)f(X,Y),p(Y)g(X,Y)) = (f(X,Y),g(X,Y)). 

The inner product satisfies {f{X, Y),g(X, Y)) equals the coefficient of 1 in 
(AX)(AY)f(X,Y)g(X- 1 ,Y- 1 ), where AX is the product of all (1 - 
over all distinct pairs of elements of X, and likewise for AY. This may 
also be expressed as a complex integral. Say \X\ = n and \Y\ = m. Then 

{1,9) = 



l^ 7 / T (AA-)(Ar)/(.Y,r )! ,(x-',r-)|lA 



dy m 



n\m\(2iri) n+m Jrp " ' x\ y m 

where T is the torus \xi\ = \yj\ = 1. Using this integral we may speak of the 
inner product of any two functions of X and Y . 

Here is our main theorem. 

Theorem 1.8. If X £ H(k 2 + £ 2 ;2k£) is large, then m\ equals 

'J[(l + x l y- 1 r 1 ^ + ^yJ 1 r 1 HS x (XX- 1 ,YY- 1 ;XY-\YX- 1 ), 

where \X\ = k and \Y\ = £. 



S 



Proof. By Lemma ll.6l noting that (x + v)(x 1 + y 1 ) equals (1 + xy 1 )(1 + 
x _1 y), the inner product in the theorem equals 

(^2^,uSa(ti)(X)S w (Y)S a{l/ )(X' 1 )S^ l/ - ) (Y' 1 ),l) 

= E ^( S a(p) ( X ) S t3(v) 00> S a(u) { X )Sp( u ) 00) 

The inner product is either 1 or 0, depending on whether a(fi) = ct(i/) and 
/3(/u) = /3(v). But this happens precisely when fi = v and so the sum is 
simply Et^.m- n 

Notation 1.9. For X = {x\, . . . ,Xf.} and Y = {yi, ■ ■ ■ ,ye} we let Zq = 
XX^UYY- 1 and Z\ = XY^UYX' 1 . In this notation Theorem O can 
be stated as 

\zieZx I 

Remark 1.10. In Corolary 21 of [3] we proved that m\ < (HS\(Zo; Z±), 1) 
for all A 



2 Integrals and Poincare series 

Recall that T(k,£;a,b) is the sum ^ mxS a /\)(A)Sprx\(B), where the sum 
is over typical partitions and where A and B are sets of cardinality a and 
6, respectively. In order to compute this T(k,£;a,b) from Theorem 11.81 we 
will need Cauchy's identity, see [8], 1.4.3. For any sets of variables X and Y 
Cauchy's identity states 

Y J S x (X)S x (Y)=H(l-xy)- 1 . 

x i« 

We extend this slightly using the factorization theorem, Theorem 10. 1 1 
Y, HS x (A;B)S a(x) (C)S m (D) 

A typical 

= E II( a + b)S aW (A)S pw (B)S aW (C)S pw {D) 

=n( a + 6 )ii( i - ac r i ri( i - M ) _i w 

where the a runs over A, the b runs over B, etc. 
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Theorem 2.1. T(k,£;a,b) equals (k\) 1 (£l) 1 (2iri) k+e time the integral of 

ri( i + ^y 1 n^o + n^ 1 - °*>) _i 

H(i - ^i)- 1 - W) IE 1 - yiy] 1 )— A - A ^ 

._/ . ._/ ■ ^1 2/6 

ewer i/te complex torus \xi\ = 1, = 1, where the a,b,ZQ,z\ run over 
A,B,Zq and Zi, respectively. 

Proof. By Theorem 11.81 if A is typical mxS a ^(A)Sp^(B) equals the inner 
product with 1 of 

H(l + z 1 )- 1 HSx(Z ;Z 1 )S a{x) (A)S m (B). 

Using equation @ to sum this over all typical A we get the inner product 
with 1 of 

na + ^r 1 + ^ IE 1 - ^r 1 IE 1 - ^r 1 - 

Interpreting the inner product as an integral as described in Definition 11,71 
completes the proof. □ 

In [13] Van Den Bergh studied integrals over the torus of the form 
/Oi,... ,z n ) JJ(1 - z 1 z~ 1 x k )~ 1 

where / is a degree Laurent polynomial. Since the product Y\{l+XiyJ 1 )(l+ 
XiyJ 1 ) divides evenly into n( z o + z\) this is the case here. Using his results 
we get this corollary. 

Corollary 2.2. T(k,£;a,b) is a rational function. The denominator can 
be written as a product of terms of the form (1 — m) where m is a monic 
monomial of degree at most k + I, and of even degree in U . If a,b are so 
large that the integral in Theorem \2.1\ has no poles at 0, then T(k, £; a, b) 
satisfies the functional equation 

^(^1 j • • • ! ta > u l }---i u b ) = 

( _ 1)( a-i)( fc+ .) +1(ti . . . ta f+i\ Ul . . . u^Titr, ...,u b ) 
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Finally, recall P'(k,£;a,b) = ^2m' x HS\(A; B), where m' x = m\ for 
large A. The computation of this function as an integral is similar to the 
computation we just did for T, except that we need the following theo- 
rem of Berele and Remmel instead of equation (jj]). We leave the proof of 
Theorem 12.41 to the reader. 

Theorem 2.3. (Berele- Remmel ' L 6j) Given four sets of variables A, B, C 
and D, 

]T HS X (A; B)HS X (C; D) = [J(l+od) \{{l+bc) JJ(l-ac)- 1 JJ(l-bd)- 1 . 

A 

Theorem 2.4. P'(k,£;a,b) equals (kl)^ 1 (ll^ 1 (2m) k+i time the integral of 

n^ 1 + ^r 1 lit 1 + z ^ + - 

na - w - ri(i - a ... a ^ 

This integral is not of the type discussed by Van Den Bergh and so we 
cannot easily derive an analogue of Corollary 12.21 It seems to us that P' 
might be less useful because of the potential presence of many terms m' x HS\ 
with m' x not equal to m\. 

3 Computation of fh\ 

As mentioned in the introduction, there is another set of multiplicities we 
are interested in closely related to the m\. Before showing how to compute 
it for large or typical A we first describe the analogues of problems 1, 3 and 
4. 

Problem lb The sum ^(x A ® X X ) i over ^ G H(k,£;n + 1) decomposes as 
a sum of irreducible characters Yl "iAX A an d we would like to compute 
the fh\. 

Problem 3b The functions <j) : MJ}^ — > M^ i which are polynomial in the 
entries and invariant under simultaneous conjugation from PL(k,£) 
form an n-graded ring with Poincare seriesequal to fhxS\(ti, . . . , t n ) 

Problem 4b Referring to the notation of Problem 4a, let R(k,£;n) be the 
algebra generated by the generic matrices A\ , . . . , A n together with the 
trace ring C(k, £; n). then R(k, £; n) is an n-graded ring with Poincare 
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series ^ fh\S\(ti, . . . , t n ). More generally, if R(k, £;n,m) is the al- 
gebra generated by Ai, . . . , A n , B\ , . . . , B m and the supertrace ring 
C(k, £;n,m), then R(k,£;n,m) has Poincare series 



P(k, I; n,m) = } m x HSx(h, ...,t n ; 



Ul, ■ ■ ■ ,Ur, 



We now turn to the computation of fh\. Given an S* n -character x = S a AX A > 
we define H(x) to be a \HS\(Zo; Z\). This map respects addition and 
has two more properties we will need. First, H respects multiplication in 
the sense that 

H{xi®X2) = H{ Xl )H{ X 2). (5) 

This follows from [5]. The second property of H is a restatement of Theo- 
rem [LEI 



Lemma 3.1. Let x = X^Ahn^X^ be such that a\ = unless A is large. 
Then 

(x, E x^xn Sn = ( n (i+zir 1 ^),!)- 

Proof. Each side of the equation equals ^ at\m\. □ 
Theorem 3.2. For each large A i/ie multiplicity rh\ equals 

( E z II (i+sir^Aczojz^iV 

Wz uZi zieZi / 

Proof. By definition, = (x X , XXx^®X M ) l)s„> summed over fi € H(k,£;n+ 
1). By Froebenius reciprocity this equals {x x t>Sx M 55 X /1 )5„+i an d X A t 
equals x^ ( § ) X A - Applying the previous lemma we get 



^a= ( n (i+zi)- 1 ^™^),! 

\ziGZi / 



By © 



H( X W®x X ) = H(x [1] )H( X X ) 

= HS[i](Z ; Zi)HS\(Z ; Z\) 

= ( E z)HS x {Z Q -Z x ). 
The theorem now follows. □ 
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Theorem 13.21 easily implies analogues of Theorems 12.11 and 12.41 an d the 
former implies an analogue of Corollary 12.21 The Poincare series we study 
are T(k,£;a,b) which equals the sum Yl™>>Sa(\)(T)Sp(X)(U) summed over 
typical A; and P'(k,£;a,b) which equals the sum ™>'\HS\(T; U), where 
m'^ is the inner product in Theorem 13.21 Here are the results. 

Theorem 3.3. T(k,£;a,b) equals (kl)- 1 (ll)- 1 (2iri) k+e time the integral of 

zeZ a UZ! 

- ^r 1 - ^j 1 ) Ho- - VrVj 1 )— A - A ^ 

over the complex torus \xi\ = 1, \y.i\ = 1, where the a,b,ZQ,z\ run over 
A,B,Zq and Zi, respectively. 

Corollary 3.4. T(k,£;a,b) is a rational function. The denominator can be 
written as a product of terms of the form (1 — m) where m is a monomial 
of degree at most k + 1, and of even degree in U. If a, b are so large that 
the integral in Theorem \3.3\ has no poles at 0, then T(k,£;a,b) satisfies the 
functional equation 

^X^i > — ) ta i u l i ■ ■ ■ i u b ) = 

( _ 1)(o -l) M+ i (tl . . . ta f^\ Ul . . . Ub )™T( tl , ...,u b ) 



Theorem 3.5. P'(k,£;a,b) equals (kl) *(£!) 1 (2m) k+e time the integral of 

^ z Ha + Zl y i + ZO b) + z x a) n(i - ^a)-* 

zeZoUZi 



na-^)- 1 !!^-^ 1 )!!^-^ 1 )^ 



dyn 

A • • • A — 

x\ yb 



4 Examples 

4.1 Case of A one row or one column 

We first compute m\ for A = (n) and A = (l n ) and k,£ arbitrary. Such A 
will be neither large nor typical and we compute it directly from the inner 
product definition m\ = J2x X( &X X summed over A £ H (k, £; n). 
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(n) (l n ) 

Lemma 4.1. With 7 as in Notation \l.ll 7^ = 8^ and 7^ = 



Proof. Referring to 1.7 of [8J, x ® X M = X 11 f° r anv A 4 an d so 7^ v = 5^ )U . 

But, considered as a function of 7* is symmetric and so 7^ = 

$u,v> as claimed. The second statement follows similarly using the identity 
^(! n ) g) t^m = yV- from example 2 in section 1.7 of [8]. □ 

Theorem 4.2. mt n ) equals the number of partitions in H(k,£;n) andmnn) 
equals the number of self-conjugate partitions in H(k,£;n). In particular, 



nit 



/ n ) 7^ mMn\ and so m\X is not symmetric under conjugation. 

Proof. By definition mi n \ = Yl^l' summed over \i G H(k,£;n); and by 

lemma [4TT1 each 7^ equals 1 and so the sum is \H(k, £; n)|. The case of m(x«) 
<i n ) 

is similar, with 7^ equaling 1 if /x is self-conjugate and otherwise. □ 

Corollary 4.3. Let f(x) = P(1,1;0, 1), g(x) = P(2,2;l,0), and let h(x) 
equal either f(x) or g(x). Then h(x) does not satisfy a functional equation 
h(x~ 1 ) = ±x a h(x). 

Proof. A partition A € H(l,l) is self-conjugate if and only if A = [0] or 
A = [a + 1, l a ] for some a > 0. Hence, 

/(X) = 1 + J2 X2a+1 = l + T^-2 = ^"'f - 

^-^ 1 — x z 1 — x z 

For g(x), note that if A € H(2,2), either A is typical or A 6 iJ(l,l). 
If A is typical, then |A| = 4 + [a(A)| + |/3(A)|, and since a(A) and /3(A) are 
partitions of height at most 2, it follows that 

t A 

1 = \(l-t)(l-t 2 )] 2 ' 
If A £ H{\, l),then either A = [0] or A is typical. It follows that 

^ (1-x) 2 



Adding, we get 



9(?) = 1 + T, 32 + 



4 

x 



(1-x) 2 (1 -x) 2 (l -x 2 ) 2 
1 — X + x 2 + x 3 — x 4 
= (l-x) 2 (l-x 2 ) 2 ' 

It is now easy to see that neither /(x) not g{x) satisfy a functional equation 
of the indicated type. □ 
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4.2 The case of (Jfe, I) = (1, 1) 

We now turn to the k = I = 1 case. This case was computed directly by 
Regev in {10j and Remmel in [11], so this computation is mostly a check on 
Theorem I2.H In this case X = {x} and Y = {y}, and so Zq = {1, 1} and 
Z\ = {|, f }• Hence, after canceling the (1 + ^)(1 + |) in the denominator 
with one of the two in the numerator, the integrand in Theorem 12.11 equals 

(! + > + ~ ) II( 1 - ^r 2 IK 1 - - y ^~Hi - ^r 1 (6) 

i j 

Since (k 2 + £ 2 ;2k£) = (2,2), we will take the case of two t's and two n's. 
The first integral is by — and the poles inside the circle are at x = yu\ and 
x = yu2- Pulling out the factor of (1 — ti) 2 (l — t 2 ) 2 , the pole at yu\ equals: 

(1 + u^)(l + Ul ) 
(1 - uiu 2 )(l - u 2 u{ l )(l - u\) 

which simplifies to 

(l + m) 

(1 - uiu 2 )(ui - n 2 )(l - ui) ' 

Integrating by ^ leaves this as it is. Similarly, if we use the pole at x = yu 2 
we simply switch U\ and u 2 yielding 

(l + ug) 

(1 - uiu 2 ){u 2 - iti)(l - u 2 ) ' 

Adding these two fractions and multiplying back the (1 — £i) 2 (l — t 2 ) 2 we 
factored out we get T(l, 1; 2, 2). 

Theorem 4.4. T(l,l;2,2) = 

2 

(l - ti) 2 (i - t 2 ) 2 (i - m)(i - u 2 )(i - u lU2 ) ' 

It follows from the identities ^ S\(u\, u 2 ) = (1 — ui) -1 (l — U2) _1 (l — 
uiu-2)' 1 and £(Ai - A 2 + 1)^(^1,^) = (1 - *i) _2 (l - t 2 )- 2 that if A and 
typical with a(\) = (ai, a 2 ) and /3(A) = (fii, (3 2 ), then = 2(a± — a 2 + 1), 
in agreement with |11| . 

In order to find m\ for smaller A, note that every A G H(l, 1) is typical, 
except for A = [0], and so m\ = m' x for all A except for mmi = 1 and 
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mj j = 0. Hence, we may use P'(l, 1; 1, 1) to compute m\ in the (1, l)-hook. 
By Theorem 12.41 we compute P'(l, 1; 1, 1) by integrating 

(l+n) 2 (l + ft)(l + ft) ^ d y 



A- (7) 



(l + f)(l + |)(l-i) 2 (l-f^)(l-|«) x y 

There are two poles: One at x = yu and one at x = —y. The former has 
residue 

(l + ») 2 (l + ^)(l + i) 
(l + u)(l + «-!)(! -i) 2 (l-u 2 ) 

which equals 

(l + ut)((* + tt) 



(l-t) 2 (l-n 2 ) 



times The pole in ([7|) at x = — y is of order two, so in order to compute 
the residue we must first multiply by (x+y) 2 , then take the partial derivative 
with respect to x, and finally substitute —y for x. The computation is a bit 
long and the result is 0. 

Theorem 4.5. P'(l, 1; 1, 1) = (1 + ut)(t + u)(l - i)~ 2 (l - n 2 )" 1 . 

It follows that if A = (a + 1, l b ), then m\ equals a + 1 if b is even and a 
if 6 is odd. 

A similar analysis can be carried out for rh\. We leave the proof to the 
reader. 

Theorem 4.6. P'(l, 1; 1, 1) = 1 + 2(t + it)(l + iti)(l - t)~ 2 (l - n)" 1 w/wc/i 
implies that fh^ a+1 ^ equals 4a + 2 if b > and rn,[ a+1 ] = 2a + 2. Also, 

P'(l,l;2,2)- 2(3 + Ul + U2 ~ U1U2) 



(1 - ti) 2 (l - t 2 ) 2 (l - u 2 )(l - u 2 )(l - muz) 
1 



(1 - £i) 2 (l - t 2 ) 2 V(l - ua)(l - «a)(l - uiu 2 ) 1 - m« 2 

It follows that if X is typical with a(A) = (ai,a 2 ) and /3(A) = (/3i,/3 2 ), i/ien 
?fiA = 8(ai — a 2 + 1) unless f}\ = /3 2 in which case fh\ = 6(«i — a 2 + 1). 

4.3 The case of (k, t) = (2, 1) 

We conclude with a peek into the unknown, thanks to a Maple computation: 
rrfn i i n\ 372 + 801t + 835t2 + 515t3 + 213t4 + 35t5 + * 6 /■o^ 

r(2,i;i.o) = (i-t)2(i_ t 2) ' (8) 
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T(2, 1; 0, 1) = (1 - u)~ 1 (372 + 780u + 1083u 2 + 1193u 3 + 1034n 4 

+ 754u 5 + 513u 6 + 319u 7 + 158u s + 54u 9 + llu 10 + u 11 ), (9) 

- 2697 + +6346t + 6641t 2 + 4449t 3 + 198U 4 + 503t 5 + 50t 6 + t 7 

( ' 5 ' ° } " (l_ t )2(l_ t 2) = 

(10) 

and 

T(2, 1; 0, 1) = (1 - ti)~ 1 (2697 + 6249u + 8817n 2 + 9587n 3 + 8706u 4 
+ 6890u 5 + 4877n 6 + 3107n 7 + 1744u 8 + 820n 9 + 301u 10 

+ 79n n + 13u 12 + u 13 ) (11) 
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